Game controller and game system

ABSTRACT

A first control unit includes a first operation data generation section for generating first operation data in accordance with a motion of a first control unit body included in the first control unit. A second control unit includes a second operation data generation section for generating second operation data in accordance with a direction input operation performed by a player or a motion of a second control unit body included in the second control unit. Further, one of the first control unit and the second control unit includes a transmission section for transmitting the first operation data and the second operation data to a computer at a predetermined timing.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.15/295,290 filed Oct. 17, 2016 which is a continuation of U.S. patentapplication Ser. No. 14/950,578 filed Nov. 24, 2015 (now U.S. Pat. No.9,498,709 issued Nov. 22, 2016) which is a continuation of U.S. patentapplication Ser. No. 14/585,318 filed Dec. 30, 2014 (now U.S. Pat. No.9,227,138 issued Jan. 5, 2016) which is a continuation of U.S. patentapplication Ser. No. 14/330,403 filed Jul. 14, 2014 (now U.S. Pat. No.9,044,671 issued Jun. 2, 2015) which is a continuation of U.S.application Ser. No. 12/285,812 filed Oct. 15, 2008 (now U.S. Pat. No.8,834,271 issued Sep. 16, 2014), which is a divisional of U.S.application Ser. No. 11/504,086, filed 15 Aug. 2006, (now U.S. Pat. No.8,267,786 issued Sep. 18, 2012), which in turn is a continuation-in-partof U.S. application Ser. No. 11/404,871, filed 17 Apr. 2006 (now U.S.Pat. No. 8,870,655 issued Oct. 28, 2014), which claims priority of JP2005-242926, filed 24 Aug. 2005, JP 2006-122681, filed Apr. 26, 2006,and U.S. Application No. 60/714,862, filed 8 Sep. 2005, the entirecontents of each of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a game controller and a game system,and more particularly to a game controller which includes two controlunits connected to each other by a flexible cable and is operated usingthe two control units and a game system including the game controller.

Description of the Background Art

For example, Japanese Laid-Open Patent Publication No. 2004-313492(hereinafter, referred to as Patent Document 1) discloses a controllerhaving its control units held by both hands of a player, respectively,so as to play a game.

The controller disclosed in Patent Document 1 is composed of an R unitto be held by a right hand of a player and an L unit to be held by aleft hand of the player. The R unit and the L unit each has an operationbutton and a stick on the top surface and the side of a housing thereof.The R unit and the L unit can be physically coupled to each other so asto be used as a combined controller.

However, the controller disclosed in Patent Document 1 is constructed bysimply separating a conventional game apparatus controller into rightand left units. That is, although a player can place his or her rightand left hands anywhere when the player holds the R and L units by hisor her right and left hands, respectively, the player cannot control thecontroller itself with improved flexibility. For example, not only thecombined controller but also the game apparatus controller separatedinto the right and the left units cannot realize a new operation.

SUMMARY OF THE INVENTION

Therefore, an object of the present invention is to provide a novel gamecontroller and game system which realize a novel operation havingenhanced flexibility by using a plurality of control units.

The present invention has the following features to attain the objectmentioned above. The reference numerals and the like in the parenthesesindicate the correspondence with the embodiment described below in orderto aid in understanding the present invention and are not intended tolimit, in any way, the scope of the present invention.

A first aspect of the present invention is directed to a game controller(7) for transmitting operation data to a computer (30) executing a gameprogram. The game controller comprises: a first control unit (70); asecond control unit (76); and a cable (79). The cable is flexible andelectrically connects between the first control unit and the secondcontrol unit. The first control unit includes a first operation datageneration section (74, 701). The first operation data generationsection generates first operation data in accordance with a motion of afirst control unit body included in the first control unit. The secondcontrol unit includes a second operation data generation section (78).The second operation data generation section generates second operationdata in accordance with a direction input operation performed by aplayer. Further, one of the first control unit and the second controlunit includes a transmission section (75). The transmission sectiontransmits the first operation data and the second operation data to thecomputer at a predetermined timing.

In a second aspect based on the first aspect, the first operation datageneration section includes an image pickup section (74). The imagepickup section is fixed to the first control unit body and takes animage of a periphery along a predetermined direction from the firstcontrol unit body. The first operation data generation section outputs,as the first operation data, one selected from the group consisting ofan image taken by the image pickup section and a result of subjectingthe image taken by the image pickup section to a predeterminedcalculation.

In a third aspect based on the second aspect, the first operation datageneration section further includes a positional information calculationsection (744). The positional information calculation section calculatespositional information indicating a position, in the image taken by theimage pickup section, of at least one marker image which is included inthe taken image and is used as an imaging target, when performing thepredetermined calculation, and outputs the positional information as thefirst operation data.

In a fourth aspect based on the first aspect, the transmission sectionwirelessly transmits the first operation data and the second operationdata to the computer.

In a fifth aspect based on the first aspect, the first operation datageneration section has one of an acceleration sensor (701) and a gyrosensor included in the first control unit body. The first operation datageneration section outputs data generated by the one of the accelerationsensor and the gyro sensor as the first operation data.

In a sixth aspect based on the first aspect, the cable is detachablyconnected to at least the first control unit. The transmission sectionis included in the first control unit.

In a seventh aspect based on the first aspect, the transmission sectioncollects and transmits to the computer the first operation data and thesecond operation data at intervals shorter than 1/60 second.

In an eighth aspect based on the first aspect, the second operation datageneration section includes a stick (78 a) which has a tip projectingfrom a second control unit body included in the second control unit andis inclinable on the second control unit body. The second operation datageneration section outputs data obtained in accordance with an incliningdirection of the stick as the second operation data.

In a ninth aspect based on the first aspect, the second operation datageneration section includes an operation button (78 f) which hasoperation portions representing at least four directions and which isable to be pushed, by the operation portions, into a second control unitbody included in the second control unit. The second operation datageneration section outputs, as the second operation data, datacorresponding to the operation portion at which the operation button ispushed.

In a tenth aspect based on the first aspect, the second operation datageneration section includes a sliding member (78 g) which has a topsurface exposed from a second control unit body included in the secondcontrol unit and which is horizontally movable on the second controlunit body. The second operation data generation section outputs dataobtained in accordance with a horizontal moving direction of the slidingmember as the second operation data.

In an eleventh aspect based on the first aspect, the second operationdata generation section includes a touch pad (78 h) on an outer surfaceof a second control unit body included in the second control unit. Thesecond operation data generation section outputs, as the secondoperation data, data obtained in accordance with a position on the touchpad at which the touch pad is touched.

In a twelfth aspect based on the first aspect, the second operation datageneration section includes at least four operation buttons (78 i, 78 j,78 k, 78 l) which are able to be pushed into a second control unit bodyincluded in the second control unit. The second operation datageneration section outputs data obtained in accordance with the pushedoperation button as the second operation data.

In a thirteenth aspect based on the first aspect, the second controlunit further includes one of an acceleration sensor (761) and a gyrosensor. One of the acceleration sensor and the gyro sensor is providedin a second control unit body included in the second control unit. Thetransmission section transmits, to the computer, data outputted by theone of the acceleration sensor and the gyro sensor as third operationdata in addition to the first operation data and the second operationdata.

In a fourteenth aspect based on the first aspect, at least one of thefirst control unit and the second control unit further includes areception section (75), a speaker (706), and a sound control unit (707).The reception section receives transmission data transmitted from thecomputer. The sound control section generates a sound from the speakerusing the transmission data having been received by the receptionsection.

A fifteenth aspect of the present invention is directed to a gamecontroller for transmitting operation data to a computer executing agame program. The game controller comprises a first control unit, asecond control unit, and a wireless connecting means. The wirelessconnecting means wirelessly connects between the first control unit andthe second control unit. The first control unit includes a firstoperation data generation section. The first operation data generationsection generates first operation data in accordance with a motion of afirst control unit body included in the first control unit. The secondcontrol unit includes a second operation data generation section. Thesecond operation data generation section generates second operation datain accordance with a direction input operation performed by a player.Further, one of the first control unit and the second control unitincludes a transmission section. The transmission section transmits thefirst operation data and the second operation data to the computer at apredetermined timing.

In a sixteenth aspect based on the fifteenth aspect, the first operationdata generation section includes an image pickup section. The imagepickup section is fixed to the first control unit body and takes animage of a periphery along a predetermined direction from the firstcontrol unit body. The first operation data generation section outputs,as the first operation data, one selected from the group consisting ofan image taken by the image pickup section and a result of subjectingthe image taken by the image pickup section to a predeterminedcalculation.

In a seventeenth aspect based on the sixteenth aspect, the firstoperation data generation section further includes a positionalinformation calculation section. The positional information calculationsection calculates positional information indicating a position, in theimage taken by the image pickup section, of at least one marker imagewhich is included in the taken image and is used as an imaging target,when performing the predetermined calculation, and outputs thepositional information as the first operation data.

In an eighteenth aspect based on the fifteenth aspect, the transmissionsection wirelessly transmits the first operation data and the secondoperation data to the computer.

In a nineteenth aspect based on the fifteenth aspect, the firstoperation data generation section has one of an acceleration sensor anda gyro sensor included in the first control unit body. The firstoperation data generation section outputs data generated by the one ofthe acceleration sensor and the gyro sensor as the first operation data.

In a twentieth aspect based on the fifteenth aspect, the transmissionsection collects and transmits to the computer the first operation dataand the second operation data at intervals shorter than 1/60 second.

In a twenty-first aspect based on the fifteenth aspect, the secondoperation data generation section includes a stick which has a tipprojecting from a second control unit body included in the secondcontrol unit and is inclinable on the second control unit body. Thesecond operation data generation section outputs data obtained inaccordance with an inclining direction of the stick as the secondoperation data.

In a twenty-second aspect based on the fifteenth aspect, the secondoperation data generation section includes an operation button (78 f)which has operation portions representing at least four directions andwhich is able to be pushed, by the operation portions, into a secondcontrol unit body included in the second control unit. The secondoperation data generation section outputs, as the second operation data,data corresponding to the operation portion at which the operationbutton is pushed.

In a twenty-third aspect based on the fifteenth aspect, the secondoperation data generation section includes a sliding member which has atop surface exposed from a second control unit body included in thesecond control unit and which is horizontally movable on the secondcontrol unit body. The second operation data generation section outputsdata obtained in accordance with a horizontal moving direction of thesliding member as the second operation data.

In a twenty-fourth aspect based on the fifteenth aspect, the secondoperation data generation section includes a touch pad on an outersurface of a second control unit body included in the second controlunit. The second operation data generation section outputs, as thesecond operation data, data obtained in accordance with a position onthe touch pad at which the touch pad is touched.

In a twenty-fifth aspect based on the fifteenth aspect, the secondoperation data generation section includes at least four operationbuttons which are able to be pushed into a second control unit bodyincluded in the second control unit. The second operation datageneration section outputs data obtained in accordance with the pushedoperation button as the second operation data.

In a twenty-sixth aspect based on the fifteenth aspect, the secondcontrol unit further includes one of an acceleration sensor and a gyrosensor. One of the acceleration sensor and the gyro sensor is providedin a second control unit body included in the second control unit. Thetransmission section transmits, to the computer, data outputted by theone of the acceleration sensor and the gyro sensor as third operationdata in addition to the first operation data and the second operationdata.

In a twenty-seventh aspect based on the fifteenth aspect, at least oneof the first control unit and the second control unit further includes areception section (75), a speaker (706), and a sound control section(707). The reception section receives transmission data transmitted fromthe computer. The sound control section generates a sound from thespeaker using the transmission data having been received by thereception section.

A twenty-eighth aspect of the present invention is directed to a gamecontroller (7) for transmitting operation data to a computer (30)executing a game program. The game controller comprises: a first controlunit (70); a second control unit (76); and a cable (79). The cable isflexible and electrically connects between the first control unit andthe second control unit. The first control unit includes a firstoperation data generation section (74, 701). The first operation datageneration section generates first operation data in accordance with amotion of a first control unit body included in the first control unit.The second control unit includes a second operation data generationsection (761). The second operation data generation section generatessecond operation data in accordance with a motion of a second controlunit body included in the second control unit. Further, one of the firstcontrol unit and the second control unit includes a transmission section(75). The transmission section transmits the first operation data andthe second operation data to the computer at a predetermined timing.

In a twenty-ninth aspect based on the twenty-eighth aspect, the firstoperation data generation section has one of a first acceleration sensor(701) and a first gyro sensor included in the first control unit body.The first operation data generation section outputs data generated bythe one of the first acceleration sensor and the first gyro sensor asthe first operation data. The second operation data generation sectionhas one of a second acceleration sensor (761) and a second gyro sensorincluded in the second control unit body. The second operation datageneration section outputs data generated by the one of the secondacceleration sensor and the second gyro sensor as the second operationdata.

In a thirtieth aspect based on the twenty-ninth aspect, the firstcontrol unit further includes a first key (72). The first key, which isprovided on the first control unit body, generates first key operationdata in accordance with a player pressing the first key. The secondcontrol unit further includes a second key (78). The second key, whichis provided on the second control unit body, generates second keyoperation data in accordance with the player pressing the second key.The transmission section transmits, to the computer, the first keyoperation data and the second key operation data in addition to thefirst operation data and the second operation data.

In a thirty-first aspect based on the twenty-eighth aspect, the firstoperation data generation section includes an image pickup section (74).The image pickup section is fixed to the first control unit body andtakes an image of a periphery along a predetermined direction from thefirst control unit body. The first operation data generation sectionoutputs, as the first operation data, one selected from the groupconsisting of an image taken by the image pickup section and a result ofsubjecting the image taken by the image pickup section to apredetermined calculation. The second operation data generation sectionhas one of a first acceleration sensor (761) and a first gyro sensor.One of the first acceleration sensor and the first gyro sensor isprovided in the second control unit body. The second operation datageneration section outputs data generated by the one of the firstacceleration sensor and the first gyro sensor as the second operationdata.

In a thirty-second aspect based on the thirty-first aspect, the firstcontrol unit further includes one of a second acceleration sensor (701)and a second gyro sensor. One of the second acceleration sensor and thesecond gyro sensor is provided in the first control unit body. Thetransmission section transmits, to the computer, data outputted by theone of the second acceleration sensor and the second gyro sensor asthird operation data in addition to the first operation data and thesecond operation data.

In a thirty-third aspect based on the twenty-eighth aspect, at least oneof the first control unit and the second control unit further includes areception section (75), a speaker (706), and a sound control section(707). The reception section receives transmission data transmitted fromthe computer. The sound control section generates a sound from thespeaker using the transmission data having been received by thereception section.

A thirty-fourth aspect of the present invention is directed to a gamesystem (1) comprising the game controller and a game apparatus (3). Thegame controller is described in the first aspect. The game apparatus iscommunicably connected to the game controller, and includes a computerfor representing a virtual game world on a display screen (2) byexecuting a game program. The game apparatus performs a game process inaccordance with at least one of the first operation data transmittedfrom the first control unit and the second operation data transmittedfrom the second control unit.

In a thirty-fifth aspect based on the thirty-fourth aspect, the gameapparatus causes a player character appearing in the virtual game worldto perform an action in accordance with at least one of the firstoperation data transmitted from the game controller and the secondoperation data transmitted from the game controller.

A thirty-sixth aspect of the present invention is directed to a gamesystem comprising the game controller and a game apparatus. The gamecontroller is described in the fifteenth aspect. The game apparatus iscommunicably connected to the game controller and includes a computerfor representing a virtual game world on a display screen by executing agame program. The game apparatus performs a game process in accordancewith at least one of the first operation data transmitted from the firstcontrol unit and the second operation data transmitted from the secondcontrol unit.

In a thirty-seventh aspect based on the thirty-sixth aspect, the gameapparatus causes a player character appearing in the virtual game worldto perform an action in accordance with at least one of the firstoperation data transmitted from the game controller and the secondoperation data transmitted from the game controller.

A thirty-eighth aspect of the present invention is directed to a gamesystem comprising the game controller and a game apparatus. The gamecontroller is described in the twenty-eighth aspect. The game apparatusis communicably connected to the game controller and includes a computerfor representing a virtual game world on a display screen by executing agame program. The game apparatus performs a game process in accordancewith at least one of the first operation data transmitted from the firstcontrol unit and the second operation data transmitted from the secondcontrol unit.

In a thirty-ninth aspect based on the thirty-eighth aspect, the gameapparatus causes a player character appearing in the virtual game worldto perform an action in accordance with at least one of the firstoperation data transmitted from the game controller and the secondoperation data transmitted from the game controller.

According to the first aspect, the first control unit generatesoperation data in accordance with a motion of a controller body includedin the game controller, and the second control unit generates operationdata in accordance with a direction input operation. Thereby, when thegame controller is used in a game, a player can make an input with afinger of one hand as in the case of a conventional controller whilemoving the other hand. That is, the player can cause his or her rightand left hands to perform respective separate operations, therebyproviding a new operation, which cannot be conventionally performed.Further, by connecting two control units to each other by a cable, thegame controller requires only one transmission section for a computer.

According to the thirteenth aspect, the first control unit generatesoperation data in accordance with a motion of a controller body includedin the game controller, and the second control unit generates operationdata in accordance with a direction input operation. Thereby, when thegame controller is used in a game, a player can make an input with afinger of one hand as in the case of a conventional controller whilemoving the other hand. That is, the player can cause his or her rightand left hands to perform respective separate operations, therebyproviding a new operation, which cannot be conventionally performed.Further, two control units are completely separated from each other,thereby providing improved controllability and enabling two players tooperate the game controller.

According to the second, third, sixteenth and seventeenth aspects, animage taken by the image pickup section fixed to the first control unitor information obtained from the taken image can be used as theoperation data. For example, a direction and a position of the firstcontrol unit with respect to the imaging target can be calculated,whereby a game operation can be performed in accordance with thedirection and the position of the unit.

According to the fourth or the eighteenth aspect, the game controllerand the computer are wirelessly connected to each other, therebyproviding improved controllability of the game controller.

According to the fifth or the nineteenth aspect, the acceleration sensoror the gyro sensor is used as the first operation data generationsection, thereby reducing a cost.

According to the sixth aspect, the cable is eliminated from the firstcontrol unit, whereby the operation data can be transmitted to thecomputer using only the first control unit.

According to the seventh or the twentieth aspect, data can be collectedand transmitted at intervals shorter than a typical game process cycle (1/60 second).

According to one of the eighth to the twelfth aspects, and thetwenty-first to the twenty-fifth aspects, the second operation datageneration section for outputting a signal in accordance with adirection input operation performed by a player can be realized by theinclinable stick, the button such as a cross key having portions to bepressed depending on a direction, the horizontally movable pad, thetouch pad, the button representing each direction and the like.

According to the thirteenth aspect, each of the units outputs theoperation data in accordance with the motion of the unit body.Therefore, a player can make an input with a finger of one hand as inthe case of a conventional controller while moving the other hand, andfurther the player can hold the separate units with both hands,respectively, thereby moving both hands individually so as to make aninput.

According to the fourteenth, twenty-seventh, and thirty-third aspects,the speaker included in one of the units outputs a sound in accordancewith data from the computer, whereby the sound can be outputted near thehand with which the player holds the unit.

According to the twenty-eighth aspect, each of the first control unitand the second control unit generates operation data in accordance witha motion of the unit body. Therefore, when the game controller is usedin a game, each of the units outputs the operation data in accordancewith the motion of the unit body, whereby the player can hold theseparate units with both hands, respectively, thereby moving both handsindividually so as to make an input. That is, the player can cause hisor her right and left hands to perform respective separate operations,thereby providing a new operation which cannot be conventionallyperformed. Further, by connecting two control units to each other by acable, the game controller requires only one transmission section for acomputer.

According to the twenty-ninth aspect, each of the units outputs theoperation data in accordance with the tilt, attitude and the like of theunit body, and therefore the player holds separate units with bothhands, respectively, thereby moving two hands individually so as to makean input.

According to the thirtieth aspect, each of the units not only outputsoperation data in accordance with a tilt, an attitude and the like ofthe unit body but also outputs operation data in accordance with aplayer performing a key operation. Therefore, the player can hold theseparate units with both hands, respectively, thereby moving both handsindividually so as to make an input, and the player can also use his orher fingers of both hands so as to perform operations.

According to the thirty-first aspect, the first control unit cancalculate a direction, a position and the like of the first control unitwith respect to the imaging target, whereby an operation can beperformed in accordance with the direction and the position of the firstcontrol unit with respect to the display device and the like. On theother hand, the second control unit can calculate a tilt, an attitude, aposition and the like of the second control unit, whereby an operationcan be performed in accordance with the attitude and the position of thesecond control unit.

According to the thirty-second aspect, the first control unit can alsocalculate a tilt, an attitude, a position and the like of the firstcontrol unit, whereby an operation can be performed in accordance withthe attitude and the position of the first control unit.

Further, the game system according to the present invention can obtainthe same effect as that of the aforementioned game controller.

These and other objects, features, aspects and advantages of the presentinvention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an external view illustrating a game system 1 according to anembodiment of the present invention;

FIG. 2 is a functional block diagram of a game apparatus 3 shown in FIG.1;

FIG. 3 is a perspective view illustrating an outer appearance of acontroller 7 shown in FIG. 1;

FIG. 4 is a perspective view illustrating a state of a connecting cable79 of the controller 7 shown in FIG. 3 being connected to ordisconnected from a core unit 70;

FIG. 5 is a perspective view of the core unit 70 shown in FIG. 3 as seenfrom the top rear side thereof;

FIG. 6 is a perspective view of the core unit 70 shown in FIG. 3 as seenfrom the bottom front side thereof;

FIG. 7 is a perspective view illustrating a state where an upper casingof the core unit 70 shown in FIG. 3 is removed;

FIG. 8 is a perspective view illustrating a state where a lower casingof the core unit 70 shown in FIG. 3 is removed;

FIG. 9 is a perspective view illustrating a first example of the subunit76 shown in FIG. 3;

FIG. 10 is a perspective view of a state where an upper casing of thesubunit 76 shown in FIG. 9 is removed;

FIGS. 11A, 11B, and 11C are a top view, a bottom view and a left sideview of a second example of the subunit 76 shown in FIG. 3,respectively;

FIG. 12 is a perspective view of the subunit 76 shown in FIG. 3 as seenfrom the top front side thereof;

FIG. 13 is a top view illustrating an example of a first modification ofthe subunit 76 shown in FIG. 3;

FIG. 14 is a top view illustrating an example of a second modificationof the subunit 76 shown in FIG. 3;

FIG. 15 is a top view illustrating an example of a third modification ofthe subunit 76 shown in FIG. 3;

FIG. 16 is a top view illustrating an example of a fourth modificationof the subunit 76 shown in FIG. 3;

FIG. 17 is a block diagram illustrating a structure of the controller 7shown in FIG. 3;

FIG. 18 is a diagram illustrating a state of a game being generallycontrolled with the controller 7 shown in FIG. 3;

FIG. 19 shows an exemplary state of a player holding the core unit 70with a right hand as seen from the front surface side of the core unit70;

FIG. 20 shows an exemplary state of a player holding the core unit 70with a right hand as seen from the left side of the core unit 70;

FIG. 21 is a diagram illustrating a viewing angle of a LED module 8L, aviewing angle of a LED module 8R, and a viewing angle of an image pickupelement 743;

FIG. 22 shows an exemplary state of a player holding the subunit 76 witha left hand as seen from the right side of the subunit 76; and

FIG. 23 shows an exemplary game image displayed on the monitor 2 whenthe game apparatus 3 executes a shooting game.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

With reference to FIG. 1, a game system 1 according to one embodiment ofthe present invention will be described. FIG. 1 is an external viewillustrating the game system 1. In the following description, the gamesystem 1 according to the present invention includes a stationary gameapparatus.

As shown in FIG. 1, the game system 1 includes a stationary gameapparatus (hereinafter, referred to simply as a “game apparatus”) 3,which is connected to a display (hereinafter, referred to as a“monitor”) 2 of a home-use television receiver or the like having aspeaker 2 a via a connection cord, and a controller 7 for givingoperation information to the game apparatus 3. The game apparatus 3 isconnected to a receiving unit 6 via a connection terminal. The receivingunit 6 receives transmission data which is wirelessly transmitted fromthe controller 7. The controller 7 and the game apparatus 3 areconnected to each other by wireless communication. On the game apparatus3, an optical disc 4 as an example of an exchangeable informationstorage medium is detachably mounted. The game apparatus 3 includes apower ON/OFF switch, a game process reset switch, and an OPEN switch foropening a top lid of the game apparatus 3 on a top main surface of thegame apparatus 3. When a player presses the OPEN switch, the lid isopened, so that the optical disc 4 can be mounted or dismounted.

Further, on the game apparatus 3, an external memory card 5 isdetachably mounted when necessary. The external memory card 5 has abackup memory or the like mounted thereon for fixedly storing saved dataor the like. The game apparatus 3 executes a game program or the likestored on the optical disc 4 and displays the result on the monitor 2 asa game image. The game apparatus 3 can also reproduce a state of a gameplayed in the past using saved data stored in the external memory card 5and display the game image on the monitor 2. A player playing with thegame apparatus 3 can enjoy the game by operating the controller 7 whilewatching the game image displayed on the monitor 2.

The controller 7 wirelessly transmits the transmission data from acommunication section 75 included therein (described later) to the gameapparatus 3 connected to the receiving unit 6, using the technology of,for example, Bluetooth (registered trademark). The controller 7 has twocontrol units, a core unit 70 and a subunit 76, connected to each otherby a flexible connecting cable 79. The controller 7 is an operationmeans for mainly operating a player object appearing in a game spacedisplayed on the monitor 2. The core unit 70 and the subunit 76 eachincludes an operation section such as a plurality of operation buttons,a key, a stick and the like. As described later in detail, the core unit70 includes an imaging information calculation section 74 for taking animage viewed from the core unit 70. As an example of an imaging targetof the imaging information calculation section 74, two LED modules 8Land 8R are provided in the vicinity of a display screen of the monitor2. The LED modules 8L and 8R each outputs infrared light forward fromthe monitor 2. Although in the present embodiment the core unit 70 andthe subunit 76 are connected to each other by the flexible cable, thesubunit 76 may have a wireless unit, thereby eliminating the connectingcable 79. For example, the subunit 76 has a Bluetooth (registeredtrademark) unit as the wireless unit, whereby the subunit 76 cantransmit operation data to the core unit 70.

Next, with reference to FIG. 2, a structure of the game apparatus 3 willbe described. FIG. 2 is a functional block diagram of the game apparatus3.

As shown in FIG. 2, the game apparatus 3 includes, for example, a RISCCPU (central processing unit) 30 for executing various types ofprograms. The CPU 30 executes a boot program stored in a boot ROM (notshown) to, for example, initialize memories including a main memory 33,and then executes a game program stored on the optical disc 4 to performgame process or the like in accordance with the game program. The CPU 30is connected to a GPU (Graphics Processing Unit) 32, the main memory 33,a DSP (Digital Signal Processor) 34, and an ARAM (audio RAM) 35 via amemory controller 31. The memory controller 31 is connected to acontroller I/F (interface) 36, a video I/F 37, an external memory I/F38, an audio I/F 39, and a disc I/F 41 via a predetermined bus. Thecontroller I/F 36, the video I/F 37, the external memory I/F 38, theaudio I/F 39 and the disc I/F 41 are respectively connected to thereceiving unit 6, the monitor 2, the external memory card 5, the speaker2 a, and a disc drive 40.

The GPU 32 performs image processing based on an instruction from theCPU 30. The GPU 32 includes, for example, a semiconductor chip forperforming calculation process necessary for displaying 3D graphics. TheGPU 32 performs the image process using a memory dedicated for imageprocess (not shown) and a part of the storage area of the main memory33. The GPU 32 generates game image data and a movie to be displayed onthe monitor 2 using such memories, and outputs the generated data ormovie to the monitor 2 via the memory controller 31 and the video I/F 37as necessary.

The main memory 33 is a storage area used by the CPU 30, and stores agame program or the like necessary for processing performed by the CPU30 as necessary. For example, the main memory 33 stores a game programread from the optical disc 4 by the CPU 30, various types of data or thelike. The game program, the various types of data or the like stored inthe main memory 33 are executed by the CPU 30.

The DSP 34 processes sound data or the like generated by the CPU 30during the execution of the game program. The DSP 34 is connected to theARAM 35 for storing the sound data or the like. The ARAM 35 is used whenthe DSP 34 performs a predetermined process (for example, storage of thegame program or sound data already read). The DSP 34 reads the sounddata stored in the ARAM 35, and outputs the sound data to the speaker 2a included in the monitor 2 via the memory controller 31 and the audioI/F 39.

The memory controller 31 comprehensively controls data transmission, andis connected to the various I/Fs described above. The controller I/F 36includes, for example, four controller I/Fs 36 a, 36 b, 36 c and 36 d,and communicably connects the game apparatus 3 to an external devicewhich is engageable via connectors of the controller I/Fs 36 a, 36 b, 36c and 36 d. For example, the receiving unit 6 is engaged with such aconnector and is connected to the game apparatus via the controller I/F36. As described above, the receiving unit 6 receives the transmissiondata from the controller 7 and outputs the transmission data to the CPU30 via the controller I/F 36. The video I/F 37 is connected to themonitor 2. The external memory I/F 38 is connected to the externalmemory card 5 and is accessible to a backup memory or the like providedin the external memory card 5. The audio I/F 39 is connected to thespeaker 2 a built in the monitor 2 such that the sound data read by theDSP 34 from the ARAM 35 or sound data directly outputted from the discdrive 40 can be outputted from the speaker 2 a. The disc I/F 41 isconnected to the disc drive 40. The disc drive 40 reads data stored at apredetermined reading position of the optical disc 4 and outputs thedata to a bus of the game apparatus 3 or the audio I/F 39.

Next, with reference to FIGS. 3 and 4, the controller 7 will bedescribed. FIG. 3 is a perspective view illustrating an outer appearanceof the controller 7. FIG. 4 is a perspective view illustrating a stateof the connecting cable 79 of the controller 7 shown in FIG. 3 beingconnected to or disconnected from the core unit 70.

As shown in FIG. 3, the controller 7 includes the core unit 70 and thesubunit 76 connected to each other by the connecting cable 79. The coreunit 70 has a housing 71 including a plurality of operation sections 72.The subunit has a housing 77 including a plurality of operation sections78. The core unit 70 and the subunit 76 are connected to each other bythe connecting cable 79.

As shown in FIG. 4, the connecting cable 79 has a connector 791detachably connected to the connector 73 of the core unit 70 at one endthereof, and the connecting cable 79 is fixedly connected to the subunit76 at the other end thereof. The connector 791 of the connecting cable79 is engaged with the connector 73 provided at the rear surface of thecore unit 70 so as to connect the core unit 70 and the subunit 76 toeach other by the connecting cable 79.

With reference to FIGS. 5 and 6, the core unit 70 will be described.FIG. 5 is a perspective view of the core unit 70 as seen from the toprear side thereof. FIG. 6 is a perspective view of the core unit 70 asseen from the bottom front side thereof.

As shown in FIGS. 5 and 6, the core unit 70 includes the housing 71formed by plastic molding or the like. The housing 71 has a generallyparallelepiped shape extending in a longitudinal direction from front torear. The overall size of the housing 71 is small enough to be held byone hand of an adult or even a child.

At the center of a front part of a top surface of the housing 71, across key 72 a is provided. The cross key 72 a is a cross-shapedfour-direction push switch. The cross key 72 a includes operationportions corresponding to the four directions (front, rear, right andleft) represented by arrows, which are respectively located oncross-shaped projecting portions arranged at intervals of 90 degrees.The player selects one of the front, rear, right and left directions bypressing one of the operation portions of the cross key 72 a. Through anoperation on the cross key 72 a, the player can, for example, instruct adirection in which a player character or the like appearing in a virtualgame world is to move or a direction in which the cursor is to move.

Although the cross key 72 a is an operation section for outputting anoperation signal in accordance with the aforementioned direction inputoperation performed by the player, such an operation section may beprovided in another form. For example, the cross key 72 a may bereplaced with a composite switch including a push switch including aring-shaped four-direction operation section and a center switchprovided at the center thereof. Alternatively, the cross key 72 a may bereplaced with an operation section which includes an inclinable stickprojecting from the top surface of the housing 71 and outputs anoperation signal in accordance with the inclining direction of thestick. Still alternatively, the cross key 72 a may be replaced with anoperation section which includes a disc-shaped member horizontallyslidable and outputs an operation signal in accordance with the slidingdirection of the disc-shaped member. Still alternatively, the cross key72 a may be replaced with a touch pad. Still alternatively, the crosskey 72 a may be replaced with an operation section which includesswitches representing at least four directions (front, rear, right andleft) and outputs an operation signal in accordance with the switchpressed by the player.

Behind the cross key 72 a on the top surface of the housing 71, aplurality of operation buttons 72 b, 72 c, 72 d, 72 e, 72 f and 72 g areprovided. The operation buttons 72 b, 72 c, 72 d, 72 e, 72 f and 72 gare each an operation section for outputting a respective operationsignal assigned to the operation buttons 72 b, 72 c, 72 d, 72 e, 72 f or72 g when the player presses a head thereof. For example, the operationbuttons 72 b, 72 c, and 72 d are assigned with functions of a firstbutton, a second button, and an A button. Further, the operation buttons72 e, 72 f and 72 g are assigned with functions of a minus button, ahome button and a plus button, for example. The operation buttons 72 b,72 c, 72 d, 72 e, 72 f and 72 g are assigned with respective functionsin accordance with the game program executed by the game apparatus 3,but this will not be described in detail because the functions are notdirectly relevant to the present invention. In an exemplary arrangementshown in FIG. 5, the operation buttons 72 b, 72 c and 72 d are arrangedin a line at the center in the front-rear direction on the top surfaceof the housing 71. The operation buttons 72 e, 72 f and 72 g arearranged in a line in the left-right direction between the operationbuttons 72 b and 72 d on the top surface of the housing 71. Theoperation button 72 f has a top surface thereof buried in the topsurface of the housing 71, so as not to be inadvertently pressed by theplayer.

In front of the cross key 72 a on the top surface of the housing 71, anoperation button 72 h is provided. The operation button 72 h is a powerswitch for remote-controlling the power of the game apparatus 3 to be onor off. The operation button 72 h also has a top surface thereof buriedin the top surface of the housing 71, so as not to be inadvertentlypressed by the player.

Behind the operation button 72 c on the top surface of the housing 71, aplurality of LEDs 702 are provided. The controller 7 is assigned acontroller type (number) so as to be distinguishable from the othercontrollers 7. For example, the LEDs 702 are used for informing theplayer of the controller type which is currently set to controller 7that he or she is using. Specifically, when the core unit 70 transmitsthe transmission data to the receiving unit 6, one of the plurality ofLEDs 702 corresponding to the controller type is lit up.

On the top surface of the housing 71, a sound hole for externallyoutputting a sound from a speaker 706 shown in FIG. 7, which will bedescribed below, is provided between the operation buttons 72 e, 72 f,and 72 g and the operation button 72 b.

On a bottom surface of the housing 71, a recessed portion is formed. Asdescribed later in detail, the recessed portion is formed at a positionat which an index finger or middle finger of the player is located whenthe player holds the core unit 70. On a rear slope surface of therecessed portion, an operation button 72 i is provided. The operationbutton 72 i is an operation section acting as, for example, a B button.The operation button 72 i is used, for example, as a trigger switch in ashooting game, or for attracting attention of a player object to apredetermined object.

On a front surface of the housing 71, an image pickup element 743included in the imaging information calculation section 74 is provided.The imaging information calculation section 74 is a system for analyzingimage data taken by the core unit 70 and detecting for the centroid, thesize and the like of an area having a high brightness in the image data.The imaging information calculation section 74 has, for example, amaximum sampling period of about 200 frames/sec., and therefore cantrace and analyze even a relatively fast motion of the core unit 70. Theimaging information calculation section 74 will be described later indetail. On a rear surface of the housing 71, the connector 73 isprovided. The connector 73 is, for example, a 32-pin edge connector, andis used for engaging and connecting the core unit 70 with the connector791 of the connecting cable 79.

With reference to FIGS. 7 and 8, an internal structure of the core unit70 will be described. FIG. 7 is a perspective view illustrating, as seenfrom the rear side of the core unit 70, a state where an upper casing (apart of the housing 71) of the core unit 70 is removed. FIG. 8 is aperspective view illustrating, as seen from the front side of the coreunit 70, a state where a lower casing (a part of the housing 71) of thecore unit 70 is removed. FIG. 8 is a perspective view illustrating areverse side of a substrate 700 shown in FIG. 7.

As shown in FIG. 7, the substrate 700 is fixed inside the housing 71. Ona top main surface of the substrate 700, the operation buttons 72 a, 72b, 72 c, 72 d, 72 e, 72 f, 72 g and 72 h, an acceleration sensor 701,the LEDs 702, an antenna 754 and the like are provided. These elementsare connected to a micro computer 751 (see FIGS. 8 and 17) and the likevia lines (not shown) formed on the substrate 700 and the like. Thewireless module 753 not shown (see FIG. 17) and the antenna 754 allowthe core unit 70 to act as a wireless controller. The quartz oscillator703 not shown, which is provided in the housing 71, generates areference clock of the micro computer 751 described later. On the topmain surface of the substrate 700, the speaker 706 and an amplifier 708are provided. The acceleration sensor 701 is provided near the edge ofthe substrate 700 offset from the center thereof. Therefore, a change ofa direction of the gravitational acceleration and an accelerationcontaining a centrifugal force component can be detected based on arotation of the core unit 70 about the longitudinal direction thereof,so that a predetermined calculation is used to determine the rotation ofthe core unit 70 with favorable accuracy based on the acceleration datahaving been detected.

As shown in FIG. 8, at a front edge of a bottom main surface of thesubstrate 700, the imaging information calculation section 74 isprovided. The imaging information calculation section 74 includes aninfrared filter 741, a lens 742, the image pickup element 743 and animage processing circuit 744 located in this order from the frontsurface of the core unit 70 on the bottom main surface of the substrate700. At a rear edge of the bottom main surface of the substrate 700, theconnector 73 is attached. Further, a sound IC 707 and the micro computer751 are provided on the bottom main surface of the substrate 700. Thesound IC 707, which is connected to the micro computer 751 and theamplifier 708 via lines formed on the substrate 700 and the like,outputs a sound signal to the speaker 706 via the amplifier 708 based onthe sound data transmitted from the game apparatus 3. On the bottom mainsurface of the substrate 700, a vibrator 704 is provided. The vibrator704 is, for example, a vibration motor or a solenoid. The core unit 70is vibrated by an actuation of the vibrator 704, and the vibration isconveyed to the player's hand holding the core unit 70. Thus, aso-called vibration-feedback game is realized. The vibrator 704 isdisposed slightly toward the front of the housing 71, thereby allowingthe housing 71 held by the player to strongly vibrate, that is, allowingthe player to easily feel the vibration.

With reference to FIGS. 9 to 12, the subunit 76 will be described. FIG.9 is a perspective view illustrating a first example of the subunit 76.FIG. 10 is a perspective view illustrating a state where an upper casing(a part of the housing 77) of the subunit 76 shown in FIG. 9 is removed.FIG. 11A is a top view illustrating a second example of the subunit 76.FIG. 11B is a bottom view illustrating the second example of the subunit76. FIG. 11C is a left side view illustrating the second example of thesubunit 76. FIG. 12 is a perspective view illustrating the secondexample of the subunit 76 as seen from the top front side thereof.

As shown in FIG. 9, the subunit 76 includes the housing 77 formed by,for example, plastic molding. The housing 77 extends in a longitudinaldirection from front to rear, and has a streamline solid shape includinga head which is a widest portion in the subunit 76. The overall size ofthe subunit 76 is small enough to be held by one hand of an adult oreven a child.

In the vicinity of the widest portion on the top surface of the housing77, a stick 78 a is provided. The stick 78 a is an operation sectionwhich includes an inclinable stick projecting from the top surface ofthe housing 77 and outputs an operation signal in accordance with theinclining direction of the stick. For example, a player can arbitrarilydesignate a direction and a position by inclining a tip of the stick inany direction of 360 degrees, whereby the player can instruct adirection in which a player character or the like appearing in a virtualgame world is to move, or can instruct a direction in which a cursor isto move.

In front of the housing 77 of the subunit 76, a plurality of operationbuttons 78 d and 78 e are provided. The operation buttons 78 d and 78 eare each an operation section for outputting a respective operationsignal assigned to the operation buttons 78 d and 78 e when the playerpresses a head thereof. For example, the operation buttons 78 d and 78 eare assigned with functions of an X button and a Y button, for example.Although the operation buttons 78 d and 78 e are assigned withrespective functions in accordance with the game program executed by thegame apparatus 3, this will not be described in detail because thefunctions are not directly relevant to the present invention. In anexemplary arrangement shown in FIG. 9, the operation buttons 78 d and 78e are aligned from the top to bottom on the front surface of the housing77.

In FIG. 10, a substrate is fixed in the housing 77. The stick 78 a, anacceleration sensor 761 and the like are provided on the top mainsurface of the substrate. The stick 78 a, the acceleration sensor 761and the like are connected to the connecting cable 79 via lines (notshown) formed on the substrate and the like.

As shown in FIGS. 11A, 11B, 11C and 12, the subunit 76 of the secondexample includes the housing 77, the stick 78 a, the operation buttons78 d and 78 e as in the case of the subunit 76 of the first example, andthe subunit 76 of the second example has the operation buttons 78 b and78 c on the top surface of the housing 77.

Behind the stick 78 a on the top surface of the housing 77, the subunit76 of the second example has a plurality of operation buttons 78 b and78 c. The operation buttons 78 b and 78 c are each an operation sectionfor outputting a respective operation signal assigned to the operationbuttons 78 b and 78 c when the player presses a head thereof. Theoperation buttons 78 b and 78 c are assigned with respective functionsin accordance with the game program executed by the game apparatus 3.However, this will not be described in detail because the functions arenot directly relevant to the present invention. In an exemplaryarrangement shown in FIGS. 11A, 11B, 11C and 12, the operation buttons78 b and 78 c are arranged in a line at the center of the top surface ofthe housing 77 in the left-right direction.

Although the stick 78 a is an operation section for outputting anoperation signal in accordance with a direction input operationperformed by the player as described above, such an operation sectionmay be provided in another form. Hereinafter, with reference to FIGS. 13to 16, a first through a fifth exemplary modifications, each of whichincludes the subunit 76 of the second example having an operationsection for outputting an operation signal in accordance with thedirection input operation, will be described.

As the first exemplary modification, as shown in FIG. 13, the subunit 76may include a cross key 78 f similar to the cross key 72 a of the coreunit 70 instead of the stick 78 a. As the second exemplary modification,as shown in FIG. 14, the subunit 76 may include a slide pad 78 g whichincludes a disc-shaped member horizontally slidable and outputs anoperation signal in accordance with the sliding direction of thedisc-shaped member, instead of the stick 78 a. As the third exemplarymodification, as shown in FIG. 15, the subunit 76 may include a touchpad 78 h instead of the stick 78 a. As the fourth exemplarymodification, as shown in FIG. 16, the subunit 76 may include anoperation section which has buttons 78 i, 78 j, 78 k, and 78 lrepresenting at least four directions (front, rear, right and left),respectively, and outputs an operation signal in accordance with thebutton (78 i, 78 j, 78 k, or 78 l) pressed by a player, instead of thestick 78 a. As the fifth exemplary modification, the subunit 76 mayinclude a composite switch including a push switch having a ring-shapedfour-direction operation section and a center switch provided at thecenter thereof, instead of the stick 78 a.

Next, with reference to FIG. 17, an internal structure of the controller7 will be described. FIG. 17 is a block diagram illustrating thestructure of the controller 7.

As shown in FIG. 17, the core unit 70 includes the communication section75 in addition to the operation section 72, the imaging informationcalculation section 74, the acceleration sensor 701, the speaker 706,the sound IC 707, and the amplifier 708 as described above. Further, thesubunit 76, which has the operation section 78 and the accelerationsensor 761 as described above, is connected to the micro computer 751via the connecting cable 79 and the connectors 791 and 73.

The imaging information calculation section 74 includes the infraredfilter 741, the lens 742, the image pickup element 743 and the imageprocessing circuit 744. The infrared filter 741 allows only infraredlight to pass therethrough, among light incident on the front surface ofthe core unit 70. The lens 742 collects the infrared light which haspassed through the infrared filter 741 and outputs the infrared light tothe image pickup element 743. The image pickup element 743 is asolid-state imaging device such as, for example, a CMOS sensor or a CCD.The image pickup element 743 takes an image of the infrared lightcollected by the lens 742. Accordingly, the image pickup element 743takes an image of only the infrared light which has passed through theinfrared filter 741 and generates image data. The image data generatedby the image pickup element 743 is processed by the image processingcircuit 744. Specifically, the image processing circuit 744 processesthe image data obtained from the image pickup element 743, identifies aspot thereof having a high brightness, and outputs process result datarepresenting the identified position coordinates and size of the area tothe communication section 75. The imaging information calculationsection 74 is fixed to the housing 71 of the core unit 70. The imagingdirection of the imaging information calculation section 74 can bechanged by changing the direction of the housing 71. The housing 71 isconnected to the subunit 76 by the flexible connecting cable 79, andtherefore the imaging direction of the imaging information calculationsection 74 is not changed by changing the direction and position of thesubunit 76. As described later in detail, a signal can be obtained inaccordance with the position and the motion of the core unit 70 based onthe process result data outputted by the imaging information calculationsection 74.

The core unit 70 preferably includes a three-axis acceleration sensor701. Further, the subunit 76 preferably includes a three-axisacceleration sensor 761. The three axis acceleration sensors 701 and 761each detects for a linear acceleration in three directions, i.e., theup/down direction, the left/right direction, and the forward/backwarddirection. Alternatively, a two axis acceleration detection means whichdetects for only a linear acceleration along each of the up/down andleft/right directions (or other pair of directions) may be used inanother embodiment depending on the type of control signals used in thegame process. For example, the three axis acceleration sensors 701 and761 or the two axis acceleration sensors 701 and 761 may be of the typeavailable from Analog Devices, Inc. or STMicroelectronics N.V.Preferably, each of the acceleration sensors 701 and 761 is of anelectrostatic capacitance (capacitance-coupling) type that is based onsilicon micro-machined MEMS (Micro Electro Mechanical Systems)technology. However, any other suitable acceleration detectiontechnology (e.g., piezoelectric type or piezoresistance type) nowexisting or later developed may be used to provide the three axisacceleration sensors 701 and 761 or two axis acceleration sensors 701and 761.

As one skilled in the art understands, the acceleration detection means,as used in the acceleration sensors 701 and 761, are capable ofdetecting for only acceleration (linear acceleration) along a straightline corresponding to each axis of the acceleration sensor. In otherwords, each of the direct outputs of the acceleration sensors 701 and761 is limited to signals indicative of linear acceleration (static ordynamic) along each of the two or three axes thereof. As a result, theacceleration sensors 701 and 761 cannot directly detect movement along anon-linear (e.g. arcuate) path, rotation, rotational movement, angulardisplacement, tilt, position, attitude or any other physicalcharacteristic.

However, through additional processing of the acceleration signalsoutput from each of the acceleration sensors 701 and 761, additionalinformation relating to the core unit 70 and the subunit 76 can beinferred or calculated, as one skilled in the art will readilyunderstand from the description herein. For example, by detecting staticacceleration (i.e., gravity), the outputs of the acceleration sensors701 and 761 can be used to infer tilt of the object (core unit 70 orsubunit 76) relative to the gravity vector by correlating tilt angleswith detected acceleration. In this way, the acceleration sensors 701and 761 can be used in combination with the micro computer 751 (oranother processor) to determine tilts, attitudes or positions of thecore unit 70 and the subunit 76. Similarly, various movements and/orpositions of the core unit 70 and the subunit 76 can be calculated orinferred through processing of the acceleration signals generated by theacceleration sensors 701 and 761 when the core unit 70 containing theacceleration sensor 701 or the subunit 76 containing the accelerationsensor 761 is subjected to dynamic accelerations by, for example, thehand of a user, as described herein. In another embodiment, each of theacceleration sensors 701 and 761 may include an embedded signalprocessor or other type of dedicated processor for performing anydesired processing of the acceleration signals outputted from theacceleration detection means prior to outputting signals to microcomputer 751. For example, the embedded or dedicated processor couldconvert the detected acceleration signal to a corresponding tilt anglewhen the acceleration sensor is intended to detect static acceleration(i.e., gravity). Data representing the acceleration detected by each ofthe acceleration sensors 701 and 761 is outputted to the communicationsection 75.

In another exemplary embodiment, at least one of the accelerationsensors 701 and 761 may be replaced with a gyro-sensor of any suitabletechnology incorporating, for example, a rotating or vibrating element.Exemplary MEMS gyro-sensors that may be used in this embodiment areavailable from Analog Devices, Inc. Unlike the acceleration sensors 701and 761, a gyro-sensor is capable of directly detecting rotation (orangular rate) around at least one axis defined by the gyroscopic elementtherein. Thus, due to the fundamental differences between a gyro-sensorand an acceleration sensor, corresponding changes need to be made to theprocessing operations that are performed on the output signals fromthese devices depending on which device is selected for a particularapplication.

More specifically, when the tilt or attitude is calculated using agyro-sensor instead of the acceleration sensor, significant changes arenecessary. Specifically, when using a gyro-sensor, the value of the tiltis initialized at the start of the detection. Then, data on the angularrate which is output from the gyro-sensor is integrated. Next, a changeamount in tilt from the value of the tilt initialized is calculated. Inthis case, the calculated tilt corresponds to an angle. In contrast,when the acceleration sensor calculates the tilt, the tilt is calculatedby comparing the value of the gravitational acceleration of each axialcomponent with a predetermined reference. Therefore, the calculated tiltcan be represented as a vector. Thus, without initialization, anabsolute direction can be determined with an acceleration detectionmeans. The type of the value calculated as the tilt is also verydifferent between a gyro sensor and an acceleration sensor; i.e., thevalue is an angle when a gyro sensor is used and is a vector when anacceleration sensor is used. Therefore, when a gyro sensor is usedinstead of an acceleration sensor or vice versa, data on tilt also needsto be processed through a predetermined conversion taking into accountthe fundamental differences between these two devices. Due to the factthat the nature of gyroscopes is known to one skilled in the art, aswell as the fundamental differences between the acceleration detectionmeans and the gyroscope, further details are not provided herein. Whilea gyro-sensor is advantageous in that a rotation can be directlydetected, an acceleration sensor is generally more cost effective whenused in connection with the controller described herein.

The communication section 75 includes the micro computer 751, a memory752, the wireless module 753 and the antenna 754. The micro computer 751controls the wireless module 753 for wirelessly transmitting thetransmission data while using the memory 752 as a storage area duringthe process. Further, the micro computer 751 controls the sound IC 707and the vibrator 704 based on data from the game apparatus 3 having beenreceived by the wireless module 753 via the antenna 754. The sound IC707 processes sound data transmitted from the game apparatus 3 via thecommunication section 75, and the like.

Data from the core unit 70 including an operation signal (core key data)from the operation section 72, acceleration signals (core accelerationdata) from the acceleration sensor 701, and the process result data fromthe imaging information calculation section 74 are outputted to themicro computer 751. An operation signal (sub key data) from theoperation section 78 of the subunit 76 and acceleration signals (subacceleration data) from the acceleration sensor 761 are outputted to themicro computer 751 via the connecting cable 79. The micro computer 751temporarily stores the input data (core key data, sub key data, coreacceleration data, sub acceleration data, and process result data) inthe memory 752 as the transmission data which is to be transmitted tothe receiving unit 6. The wireless transmission from the communicationsection 75 to the receiving unit 6 is performed periodically at apredetermined time interval. Since game process is generally performedat a cycle of 1/60 sec., data needs to be collected and transmitted at acycle of a shorter time period. Specifically, the game process unit is16.7 ms ( 1/60 sec.), and the transmission interval of the communicationsection 75 structured using the Bluetooth (registered trademark)technology is 5 ms. At the transmission timing to the receiving unit 6,the micro computer 751 outputs the transmission data stored in thememory 752 as a series of operation information to the wireless module753. The wireless module 753 uses, for example, the Bluetooth(registered trademark) technology to modulate the operation informationonto a carrier wave of a predetermined frequency, and radiates the lowpower radio wave signal from the antenna 754. Thus, the core key datafrom the operation section 72 included in the core unit 70, the sub keydata from the operation section 78 included in the subunit 76, the coreacceleration data from the acceleration sensor 701 included in the coreunit 70, the sub acceleration data from the acceleration sensor 761included in the subunit 76, and the process result data from the imaginginformation calculation section 74 are modulated onto the low powerradio wave signal by the wireless module 753 and radiated from the coreunit 70. The receiving unit 6 of the game apparatus 3 receives the lowpower radio wave signal, and the game apparatus 3 demodulates or decodesthe low power radio wave signal to obtain the series of operationinformation (the core key data, the sub key data, the core accelerationdata, the sub acceleration data and the process result data). Based onthe obtained operation information and the game program, the CPU 30 ofthe game apparatus 3 performs the game process. In the case where thecommunication section 75 is structured using the Bluetooth (registeredtrademark) technology, the communication section 75 can have a functionof receiving transmission data which is wirelessly transmitted fromother devices.

As shown in FIG. 18, in order to play a game using the controller 7 withthe game system 1, a player holds the core unit 70 with one hand (forexample, a right hand) (see FIGS. 19 and 20), and holds the subunit 76with the other hand (for example, a left hand) (see FIG. 22). The playerholds the core unit 70 so as to point the front surface of the core unit70 (that is, a side having an entrance through which light is incidenton the imaging information calculation section 74 taking an image of thelight) to the monitor 2. On the other hand, two LED modules 8L and 8Rare provided in the vicinity of the display screen of the monitor 2. TheLED modules 8L and 8R each outputs infrared light forward from themonitor 2.

When a player holds the core unit 70 so as to point the front surfacethereof to the monitor 2, infrared lights outputted by the two LEDmodules 8L and 8R are incident on the imaging information calculationsection 74. The image pickup element 743 takes images of the infraredlights incident through the infrared filter 741 and the lens 742, andthe image processing circuit 744 processes the taken images. The imaginginformation calculation section 74 detects infrared components outputtedby the LED modules 8L and 8R so as to obtain positions and areainformation of the LED modules 8L and 8R. Specifically, the imaginginformation calculation section 74 analyzes image data taken by theimage pickup element 743, eliminates images which do not represent theinfrared lights outputted by the LED modules 8L and 8R from the areainformation, and identifies points each having a high brightness aspositions of the LED modules 8L and 8R. The imaging informationcalculation section 74 obtains position coordinates, coordinates of thecentroid, and the like of each of the identified points having the highbrightness and outputs the same as the process result data. When suchprocess result data is transmitted to the game apparatus 3, the gameapparatus 3 can obtain, based on the position coordinates and thecoordinates of the centroid, operation signals relating to the motion,attitude, position and the like of the imaging information calculationsection 74, that is, the core unit 70, with respect to the LED modules8L and 8R. Specifically, the position having a high brightness in theimage obtained through the communication section 75 is changed inaccordance with the motion of the core unit 70, and therefore adirection input or coordinate input is performed in accordance with theposition having the high brightness being changed, thereby enabling adirection input or a coordinate input to be performed along the movingdirection of the core unit 70.

Thus, the imaging information calculation section 74 of the core unit 70takes images of stationary markers (infrared lights from the two LEDmodules 8L and 8R in the present embodiment), and therefore the gameapparatus 3 can use the process result data relating to the motion,attitude, position and the like of the core unit 70 in the game process,whereby an operation input, which is different from an input made bypressing an operation button or using an operation key, is furtherintuitively performed. As described above, since the markers areprovided in the vicinity of the display screen of the monitor 2, themotion, attitude, position and the like of the core unit 70 with respectto the display screen of the monitor 2 can be easily calculated based onpositions from the markers. That is, the process result data used forobtaining the motion, attitude, position and the like of the core unit70 can be used as operation input immediately applied to the displayscreen of the monitor 2.

With reference to FIGS. 19 and 20, a state of a player holding the coreunit 70 with one hand will be described. FIG. 19 shows an exemplarystate of a player holding the core unit 70 with a right hand as seenfrom the front surface side of the core unit 70. FIG. 20 shows anexemplary state of a player holding the core unit 70 with a right handas seen from the left side of the core unit 70.

As shown in FIGS. 19 and 20, the overall size of the core unit 70 issmall enough to be held by one hand of an adult or even a child. Whenthe player puts a thumb on the top surface of the core unit 70 (forexample, near the cross key 72 a), and puts an index finger in therecessed portion on the bottom surface of the core unit 70 (for example,near the operation button 72 i), the light entrance of the imaginginformation calculation section 74 on the front surface of the core unit70 is exposed forward to the player. It should be understood that alsowhen the player holds the core unit 70 with a left hand, the holdingstate is the same as that described for the right hand.

Thus, the core unit 70 allows a player to easily operate the operationsection 72 such as the cross key 72 a or the operation button 72 i whileholding the core unit 70 with one hand. Further, when the player holdsthe core unit 70 with one hand, the light entrance of the imaginginformation calculation section 74 on the front surface of the core unit70 is exposed, whereby the light entrance can easily receive infraredlights from the aforementioned two LED modules 8L and 8R. That is, theplayer can hold the core unit 70 with one hand without preventing theimaging information calculation section 74 from functioning. That is,when the player moves his or her hand holding the core unit 70 withrespect to the display screen, the core unit 70 can further perform anoperation input enabling a motion of the player's hand to directly acton the display screen.

As shown in FIG. 21, the LED modules 8L and 8R each has a viewing angleθ1. The image pickup element 743 has a viewing angle θ2. For example,the viewing angle θ1 of the LED modules 8L and 8R is 34 degrees(half-value angle), and the viewing angle θ2 of the image pickup element743 is 41 degrees. When both the LED modules 8L and 8R are in theviewing angle θ2 of the image pickup element 743, and the image pickupelement 743 is in the viewing angle θ1 of the LED module 8L and theviewing angle θ1 of the LED module 8R, the game apparatus 3 determines aposition of the core unit 70 using positional information relating tothe point having high brightness of the two LED modules 8L and 8R.

When either the LED module 8L or LED module 8R is in the viewing angleθ2 of the image pickup element 743, or when the image pickup element 743is in either the viewing angle θ1 of the LED module 8L or the viewingangle θ1 of the LED module 8R, the game apparatus 3 determines aposition of the core unit 70 using the positional information relatingto the point having high brightness of the LED module 8L or the LEDmodule 8R.

As described above, the tilt, attitude or position of the core unit 70can be determined based on the output (core acceleration data) from theacceleration sensor 701 of the core unit 70. That is, the core unit 70functions as an operation input means for performing an operation inaccordance with a player moving a hand holding the core unit 70, forexample, upward, downward, leftward, or rightward.

Next, with reference to FIG. 22, a state of a player holding the subunit76 with one hand will be described. FIG. 22 shows an exemplary state ofa player holding the subunit 76 with a left hand as seen from the rightside of the subunit 76.

As shown in FIG. 22, the overall size of the subunit 76 is small enoughto be held by one hand of an adult or even a child. For example, aplayer can put a thumb on the top surface of the subunit 76 (forexample, near the stick 78 a), put an index finger on the front surfaceof the subunit 76 (for example, near the operation buttons 78 d and 78e), and put a middle finger, a ring finger and a little finger on thebottom surface of the subunit 76 so as to hold the subunit 76. It shouldbe understood that also when the player holds the subunit 76 with aright hand, the holding state is similar to that described for the lefthand. Thus, the subunit 76 allows the player to easily operate theoperation section 78 such as the stick 78 a and the operation buttons 78d and 78 e while holding the subunit 76 with one hand.

As described above, the tilt, attitude or position of the subunit 76 canbe determined based on the output (sub acceleration data) from theacceleration sensor 761 of the subunit 76. That is, the subunit 76functions as an operation input means for performing an operation inaccordance with the player moving a hand holding the subunit 76, forexample, upward, downward, leftward, and rightward.

Here, an exemplary game played using the aforementioned controller 7will be described. As a first example, a shooting game played using thecontroller 7 will be described. FIG. 23 is a diagram illustrating anexemplary game image displayed on the monitor 2 when the game apparatus3 executes the shooting game.

As shown in FIG. 23, a portion of a three-dimensional virtual game spaceS is displayed on the display screen of the monitor 2. As a game objectacting in accordance with an operation of the controller 7, a portion ofthe player character P and a portion of a gun G held by the playercharacter P are displayed on the display screen. Moreover, the virtualgame space S displayed on the display screen represents a field of frontvision of the player character P, and for example an opponent characterE is displayed as a shooting target in FIG. 23. A target indicating aposition at which the player character P shoots the gun G is displayedon the display screen as the target cursor T.

In the shooting game having such a game image displayed on the monitor2, a player operates the core unit 70 with one hand and operates thesubunit 76 with the other hand as shown in FIG. 18 so as to play thegame. For example, when the player inclines the stick 78 a (see FIGS.11A, 11B, 11C and 12) on the subunit 76, the player character P is movedin the virtual game space S in accordance with the inclining direction.Further, when the player moves his or her hand holding the core unit 70with respect to the display screen, the target cursor T is moved inaccordance with the motion, attitude, position and the like of the coreunit 70 with respect to the monitor 2 (LED modules 8L and 8R). When theplayer presses the operation button 72 i (shown in FIG. 6) on the coreunit 70, the player character P shoots the gun G at the target cursor T.

That is, while the player uses the stick 78 a on the subunit 76 so as toinstruct the player character P to move, the player can operate the coreunit 70 as if the core unit 70 is a gun for the shooting game, therebyenhancing enjoyment in playing a shooting game. The player can performan operation of moving the player character P and an operation of movingthe target cursor T by using respective units held by different hands,whereby the player can perform the respective operations as independentones. For example, since the virtual game space S displayed on thedisplay screen is changed in accordance with the movement of the playercharacter P, it is sometimes difficult to keep the target positionednear a position observed by the player in the virtual game space Sbecause, for example, the player may be paying attention to the opponentcharacter E suddenly jumping into the virtual game space S. However,while the player is moving the player character P with one hand (forexample, a thumb of a left hand), the player can control a motion of thearm (for example, a right arm) which is not used for moving the playercharacter P such that the core unit 70 has its front surface pointed tothe observed position, thereby substantially enhancing flexibility foroperating the controller 7 and increasing the reality of the shootinggame. Further, in order to move the target cursor T, the player movesthe controller. However, the operation of moving the controller does nothinder the player from performing a direction instruction operation formoving the player character P, thereby enabling the player to stablyperform the two direction instruction operations. That is, by using thecontroller 7, the player can freely use his or her left and right handsand can perform a new operation having increased flexibility, whichcannot be achieved using a physically single controller.

In a second example, a player inclines the stick 78 a on the subunit 76so as to move the player character P in the virtual game space S inaccordance with the inclining direction as in the first example. Theplayer moves a hand holding the core unit 70 with respect to the displayscreen so as to move a sight point of a virtual camera in accordancewith a position of the core unit 70 with respect to the monitor 2 (LEDmodules 8L and 8R). These operations allow the player to observe aposition to which the core unit 70 is pointed in the virtual game spaceS while operating the stick 78 a on the subunit 76 so as to instruct theplayer character P to move.

In the above description, the controller 7 and the game apparatus 3 areconnected to each other by wireless communication. However, thecontroller 7 and the game apparatus 3 may be electrically connected toeach other by a cable. In this case, the cable connected to the coreunit 70 is connected to a connection terminal of the game apparatus 3.

Moreover, in the present embodiment, only the core unit 70 among thecore unit 70 and the subunit 76 of the controller 7 has thecommunication section 75. However, the subunit 76 may have thecommunication section for wirelessly transmitting the transmission datato the receiving unit 6. Further, both the core unit 70 and the subunit76 may have the respective communication sections. For example, therespective communication sections included in the core unit 70 and thesubunit 76 may wirelessly transmit the transmission data to thereceiving unit 6, or the communication section of the subunit 76 maywirelessly transmit the transmission data to the communication section75 of the core unit 70, and the communication section 75 of the coreunit 70 may wirelessly transmit, to the receiving unit 6, the receivedtransmission data from the subunit 76 and the transmission data of thecore unit 70. In these cases, the connecting cable 79 for electricallyconnecting between the core unit 70 and the subunit 76 can beeliminated.

In the above description, the receiving unit 6 connected to theconnection terminal of the game apparatus 3 is used as a receiving meansfor receiving transmission data which is wirelessly transmitted from thecontroller 7. Alternatively, the receiving means may be a receivingmodule built in the game apparatus 3. In this case, the transmissiondata received by the receiving module is outputted to the CPU 30 via apredetermined bus.

Although in the present embodiment the imaging information calculationsection 74 included in the core unit 70 is described as an example of adetermining section for outputting a signal (process result data) inaccordance with a motion of the core unit 70 body, the imaginginformation calculation section 74 may be provided in another form. Forexample, the core unit 70 may include the acceleration sensor 701 asdescribed above, or may include a gyro sensor. The acceleration sensoror the gyro sensor can be used to determine a motion or attitude of thecore unit 70, and, therefore, can be used as a determining section foroutputting a signal in accordance with the motion of the core unit 70body using the detection signal for the motion or attitude. In thiscase, the imaging information calculation section 74 may be eliminatedfrom the core unit 70, or sensor and the imaging information calculationsection can be used in combination.

Further, although in the present embodiment only the core unit 70includes the imaging information calculation section 74, the subunit 76may also include a similar imaging information calculation section.

Further, when the controller 7 includes a plurality of units, each ofwhich may have a plurality of operation means such as the imaginginformation calculation section, the acceleration sensor, the gyrosensor, the stick, the cross key, and the operation button, variouscombination of the operation means can realize various controllers.Here, the operation means included in the core unit 70 and the subunit76 are classified into an operation means A and an operation means B.The operation means A, such as the imaging information calculationsection 74, the acceleration sensors 701 and 761, and the gyro sensor,outputs a signal in accordance with the movement of the unit body. Theoperation means B, such as the stick, the cross key, the operationbutton, the touch pad, outputs a signal in accordance with the playerpressing a button, tilting a component or touching the same.

When the core unit 70 includes the operation means A and the subunit 76includes the operation means B, the player can move one hand holding thecore unit 70 while the player makes an input with a finger of the otherhand holding the subunit 76 as in the case of a conventional controller.

That is, the player can perform different operations with a right and aleft hands, respectively, thereby realizing a new operation which cannotbe performed by a conventional controller. In this case, according tothe present invention, operation data outputted by the operation means Acorresponds to first operation data, and operation data outputted by theoperation means B corresponds to second operation data. Further, thecontroller may be constructed such that the subunit 76 may include theoperation means A, the core unit 70 may include the operation means A,and the subunit 76 may include the operation means A and the operationmeans B. In this manner, the player can move both hands individually,thereby realizing an increasingly improved operation. In this case,according to the present invention, operation data outputted by theoperation means A of the subunit 76 corresponds to third operation data.

Further, when the core unit 70 and the subunit 76 each includes theoperation means A, the player can move one hand holding the core unit 70while the player can move the other hand holding the subunit 76 so as tomake an input. That is, the player can move a right and a left handsindividually, thereby realizing a new operation which cannot beperformed by a conventional controller. In this case, according to thepresent invention, operation data outputted by the respective operationmeans A of the core unit 70 and the subunit 76 correspond to firstoperation data and second operation data. Further, each of the core unit70 and the subunit 76 may include both the operation means A and theoperation means B. In this manner, the player can perform operations bymoving both hands and using fingers of both hands, thereby realizing anew operation. In this case, according to the present invention,operation data outputted by the operation means B of the core unit 70corresponds to first key operation data, and operation data outputted bythe operation means B of the subunit 76 corresponds to second keyoperation data.

Furthermore, when each of the core unit 70 and the subunit 76 includesthe operation means A, one of the core unit 70 or the subunit 76 mayinclude various types of operation means A. As described above, when theoperation means A includes the imaging information calculation section,a direction, a position and the like of the unit with respect to theimaging target (marker) can be calculated, thereby enabling an operationbased on the direction and the position of the unit with respect to themonitor 2. On the other hand, when the operation means A includes theacceleration sensor or the gyro sensor, a tilt, an attitude, a positionand the like of the unit itself can be calculated, thereby enabling anoperation based on the attitude and the position of the unit.Accordingly, when the core unit 70 includes the imaging informationcalculation section and one of the acceleration sensor or the gyrosensor, and the subunit 76 includes the acceleration sensor or the gyrosensor, the core unit 70 can perform the aforementioned two operations.In this case, according to the present invention, operation dataoutputted by the imaging information calculation section of the coreunit 70 corresponds to first operation data, operation data outputted bythe acceleration sensor or the gyro sensor of the subunit 76 correspondsto second operation data, and operation data outputted by theacceleration sensor or the gyro sensor of the core unit 70 correspondsto third operation data.

In the present embodiment, image data taken by the image pickup element743 is analyzed so as to obtain position coordinates and the like of animage of infrared lights from the LED modules 8L and 8R, and the coreunit 70 generates process result data from the obtained coordinates andthe like and transmits the process result data to the game apparatus 3.However, the core unit 70 may transmit data obtained in another processstep to the game apparatus 3. For example, the core unit 70 transmits tothe game apparatus 3 image data taken by the image pickup element 743,and the CPU 30 may perform the aforementioned analysis so as to obtainprocess result data. In this case, the image processing circuit 744 canbe eliminated from the core unit 70. Alternatively, the core unit 70 maytransmit, to the game apparatus 3, the image data having been analyzedhalfway. For example, the core unit 70 transmits to the game apparatus 3data indicating a brightness, a position, an area size and the likeobtained from the image data, and the CPU 30 may perform the remaininganalysis so as to obtain process result data.

Although in the present embodiment infrared lights from the two LEDmodules 8L and 8R are used as imaging targets of the imaging informationcalculation section 74 in the core unit 70, the imaging target is notrestricted thereto. For example, infrared light from one LED module orinfrared lights from at least three LED modules provided in the vicinityof the monitor 2 may be used as the imaging target of the imaginginformation calculation section 74. Alternatively, the display screen ofthe monitor 2 or another emitter (room light or the like) can be used asthe imaging target of the imaging information calculation section 74.When the position of the core unit 70 with respect to the display screenis calculated based on the positional relationship between the imagingtarget and the display screen of the monitor 2, various emitters can beused as the imaging target of the imaging information calculationsection 74.

The aforementioned shapes of the core unit 70 and the subunit 76 aremerely examples. Further, the shape, the number, setting position andthe like of each of the operation section 72 of the core unit 70 and theoperation section 78 of the subunit 76 are merely examples. Needless tosay, even when the shape, the number, the setting position and the likeof each of the core unit 70, the subunit 76, the operation section 72,and the operation section 78 are different from those described in theembodiment, the present invention can be realized. Further, the imaginginformation calculation section 74 (light entrance of the imaginginformation calculation section 74) of the core unit 70 may not bepositioned on the front surface of the housing 71. The imaginginformation calculation section 74 may be provided on another surface atwhich light can be received from the exterior of the housing 71.

Further, although the speaker 706, the sound IC 707, and the amplifier708 as described above are included in the core unit 70, any devices athand capable of outputting a sound may be included in either the subunit76 or the core unit 70.

Thus, the controller of the present invention allows a player to operateboth the core unit 70 and the subunit 76 included therein so as to enjoya game. For example, the core unit 70 has a function of outputting asignal in accordance with a motion of the unit body including theimaging information calculation section 74 and the accelerator sensor701, and the subunit 76 has a function of outputting a signal inaccordance with a direction input operation performed by the player. Forexample, when used is a controller into which the core unit 70 and thesubunit 76 are integrated, the whole controller has to be moved so as tooutput a signal in accordance with the motion of the unit body, therebyexerting some influence on the direction input operation. Further, theintegration of the core unit 70 and the subunit 76 causes the oppositeinfluence, that is, flexibility, which is realized by separation betweenthe core unit 70 and the subunit 76, is substantially reduced. Asanother example, the core unit 70 may have a function of outputting asignal in accordance with a motion of the unit body including theimaging information calculation section 74 and the acceleration sensor701, and the subunit 76 may have a function of outputting a signal inaccordance with the motion of the unit body including the accelerationsensor 761. Therefore, the player can move both hands holding thedifferent units individually so as to make an input. Accordingly, thecore unit 70 and the subunit 76 can be separated into a right unit and aleft unit as in the case of a conventional controller for the gameapparatus, and simultaneously the core unit 70 and the subunit 76 allowthe player to freely use his or her right and left hands, therebyproviding the player with a new operation, which cannot be performed bythe integrated controller. Further, the controller can be operated withsubstantially enhanced flexibility, thereby providing a player with agame operation having increased reality.

The game controller and the game system according to the presentinvention can realize an operation having increased flexibility, and areuseful as a game controller which includes two independent units and isoperated by a player holding the two independent units, a game systemincluding the game controller, and the like.

While the invention has been described in detail, the foregoingdescription is in all aspects illustrative and not restrictive. It isunderstood that numerous other modifications and variations can bedevised without departing from the scope of the invention.

What is claimed is:
 1. A game controller, comprising: an elongatedhousing having a substantially rectangular shape, the housingcomprising: a top surface, a bottom surface, a front end, and a rearend; a touch-sensitive panel located at an upper half of the top surfaceof the housing; a home button located at the top surface of the housing,the home button positioned between the touch-sensitive panel and therear end of the housing; an inertial sensor configured to produce datausable in detecting attitude and/or orientation of the housing of thegame controller; and processing circuitry operatively coupled to thetouch-sensitive panel, the home button, and the inertial sensor, andconfigured to process data in response to input made in association withthe touch-sensitive panel, the home button, and/or the inertial sensor.